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h A method forwe in a midtimedia conferene- 
iog anarigement to contid mtdtiirie cpncunent 
eaSs where aadi call comprises one or more 
channels. A first c^ among a ftst set (rf user 
stations and a seccHid caB among a second set 
of user stations are meiged kito a single call 
comp^^ a pltisdi^ of tdiannels among at 
least flitee user stations finm the ftst and 
second sets. The phiiaW^ at ehannds of the 
single, nwiged cefl corr^pantte to a comt^ 
naSon of diannels <^ fiie itet and second cads 
and may Indude a i^nalling channel, a voice 
diannel, and one data channd far each data 
channel of tiie first and second calls. The 
m^ud is also aiqdicable to caDs induding 
'mage a video chamels. 
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Taehnfeal Fleid 

This InvenBon rdates to comrmmicafion con- 
fsrent^ng. 

Background of th» invanfion 

U. S. Patent4.905^1, issued to W. F. L«ji^ et 
al. on Febmaiy 27( 1990, di$doses a multimedia conv- 
municafion system ua'ng a single packet switching 
network for the various media tjased on what is refer- 
red to as a multimedia virtual circuit A vttual dreuit 
is a padcet-switehed communicafions path t>etweffli 
two endpoints. A network call set up procedure 
establishes a \*tuai circi* and an associated viiftjai 
circuit identifier based ort a destination address. To 
route successhre padcets, the netwak needs only the 
virtual ctaiit identifier. In a mulUmedia virhial circuit, 
a virtual circuit is divided into multiple virtual channels 
at the workstations. Eadi drannd represents a diffe- 
rent infofmation medium and has a separate channel 
klentilier: the composite mui^media virtusri dreuit rep- 
resents tfie resulting multimedia can. As the various 
multimedia call sources ger»rate trafRc, the works- 
tation multiplexes the pactetized trafRc onto a single 
network virtual circuit The destination workstaSon 
demultiplexes, tiiis baffle tsadc into muliiple channels, 
which it routes to a telephone, speaker, file or other 
destinafon, TTiis process preserves the temporal 
ordering of the intomiation streams so fiiat in a votee 
and vWeo cdl, for example, the voice corresponds to 
the mouth movement in the video pidure. The mil- 
timedia virtual tircuit also protfidesasimplewaytolet 
a mtdtimedia call desfimriton assodats the mMste 
media. A single incoming call notSication arrhres fioom 
the netwoikto announce a call. The wisksiatkHis then 
exchange signaling Information overavblual channel 
of the multimolla virtual circuit to set up all the neces- 
sary channels and to route th«n to the appropriate 
dewces. 

The Rapport multimedia conferencing system, 
disdosed in the S. R. Ahuja et ai. article, "The Rapport 
MultHtiedia Conferendng System," Proceedings of 
ConfaBnce on Office Infamatfon Systems, Mardi 
1988, supports Inleraofiwe, real-time distributed con- 
ferences among two or mate people Executing on 
personal woitetations Inferconneded by separate 
d^ and voice networks, the Rapport ^stem pro- 
vide baa'c mechanisms to create, manage, and to'- 
mlnate conferences. The ^stem provides an 
envircmment in which many iypes of meeting can take 
place, including telephone conversa&ins, d'scussion 
among cdleagues, and lectures. Existing wcHfc^on 
programs can be used during a conierencetofxoduce 
and edit data and displays for ccHiferees. I^pport is 
designed to help peo^e «nuIalBfEK»-io4a<a confer- 
ences as dosely as possible with fiieir worksMcss. 
However, flie reriance on separate i«iwoite for fite 



dBferentmedra (data and vdce) substantially compli- 
cal^ file contrd of conference calls. Although con- 
Gunent partldpafion In many confensnces is possible, 
a user is ordy able to communicate on one call at a 

5 time. A Rapport system user may par&^»ate hi many 
conferences concunrently by switdiing nnong con- 
test at Hie didc of a mouse button. This Is «]uh«lent 
to beir^ sMe to walk in and out cf several meeting 
rooms (and one'scffice) irstently. It isanfidpated that 

10 Ihiscap^BtiywilenGOurageusastokeepmanyGon- 
feiences acfive for long periods of time in much the 
same ^hion as the use of screen windows allows 
one to keep many programs and files adive with the 
present date networks. One such tong-lived confer- 

is ence might be an intercom connection between a 
manager and a secretery. Others might be among the 
collaborators in a design prqjed or the authors of a 
paper. It is anticipated that once &ie capability for mul- 
tiple concun-ent calls is provided, it wfl! be ireful to 

20 merge and split such calls. For example, the manager 
m^ ask fite secretary to jdn a design prefect confer- 
ence from time tofime toassistflte prejectteam. The 
effediva control cX a pluralify of a mulfimedla calls 
poses a tsehnio^ problem, paificulaily in flie Rapport 

2S system anrangement comprising several separate 
networks, but also for the system of the above-re^r- 
enced U.S. Patent 4,9(^;231 oiqiloying a single net- 
wnk for all media. 

30 SotoMtm 

This pttitAm sohred and a technical advance 
is achieved In accordance with the principles of the 
inventK)n in a m^hod forocHifindiir^ inuMi^e conoir- 

35 rent calls vAiere each call comprises one or more 
channels. Af^cdlamongafkst set of user stetions 
and a second call among a second set of userstetlons 
are, for example, merged into a single call comprising 
a plurality of channels among, signfflcantiy, at least 

40 three user stetions from thefirstand second sets. The 
plurality of channels of the single, merged c^ corres- 
ponds to a combination of channels of the first and 
second calls and, fliustratively, may indude a signal- 
ling channel, a vfj^Bs diannel, aixi one data diannel 

45 tor eadi data dtamei of the ftat and second calls 
{FIG. 1}. The methodls also appikabto to (alls indud- 
b]g im^ or video channels. 

In an ilustrafive embodiment, a user titertece is 
prwkted mSt that fee fbst call is ^bllsh^i in res- 

s> poRse to user e.g., hiput via a mouse tnjtton, and, in 
addition, representattons, e.g., face icons corre- 
sponding to users of the first set of user stations, are 
diplayed in a window of a display (FIG. 17). The sec- 
ond call is estet^ished in similar teshion among Itie 

55 second set of user stefions. The merging of the two 
callsise^Med inrKponsetouserinputatauserste- 
tton fiiat is amemberofbi^ tie trstsoKi seqond sets. 
As a resaiitctf the merge, representattons corce^cRKl- 
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ing toSieuserstations of the first and second sets are 
drspky«i fci awindowfbrthe merged cadL in addi&xt, 
tepresentsBons consspomfii^ to one of the 
l^ay of chanh^s erf Sie mei^ed call are also dis- 
playedinthe«rindowJconsfH^avok»cteflnel.adata s 
channel being used for a diarader-based application 
ksh, and a data channel being used ftar a graphical- 
based application EZ. are aiusttated in HG. 19 in a 
representation of a conference room. The data cora- 
munlcafion apfdications themselves are iSsfts^ in 10 
ottjer windows. An access control madrantsm |»o- 
vides sdectfve acc^s for a usar station to transmit 
infonma&Ki to and raeejva Inforinaiioii from the 
pluiai^ of diannefa of fiie irai^ eaB. The pJiaaBy 
of channcte of the merged can eomprfee lAtual dian- is 
nm of a mdticsse connection flinwgh a padtet 
switching rietyvOik. A merge request is transmitted 
fiom fifom ore user station via the network to each of 
the other user stafions of the first and second set The 
merging is initiated in response to receipt of a fevor- 20 
ali^e reply from each of the other us& stations. 

In a method of the Invention, a s'ngie call, com- 
prisii^ a plurality of channels, is provided among a set 
of user stations. The single call ^ spitt into a first call 
amongafirstsubsetofuserstaSonsandaseeondcall 2S 
anxmg a second substf of user i^atkms. Theliist call 
'mdudes «*annds correspondit^ to a fira subset of 
the channds a fte single call and *e second csil 
tndudes channels corresponding to a second subset 
of the channels of the single call (FIG. 2). 30 

A further method of the invenfion is used in an 
aitangement comprising a communication network 
Interconnecting a plurality of user stations. A first call, 
comprising at least a voice channel, is provided 
among a first set of us«r stations, and a second call, 3S 
comprising at least a voice channel, prowded 
among 

aseoondsetofusarstations. OneuserstaBon 
is a member of both of the first and second sets. The 
one user stafton enables a user to c«mnur4cate via 
both ofthofirstand second oalsiEtflw same tki». 4o 

Illu^xafiveV, fte one liser sfc^n comprises a 
voice bridge, implemCTted. ftnr ©ample, u^ a 
plurality of voice packet/analt^ voice converters, and 
a conventional analc^ voice bridge. A user is able to 
convnurucate on two (or more) calls at a time. The 4S 
user Is able to iiansmft voice ctmcurrentiy on (he voice 
ctennelsofbotttttfthefirst and second calls. The user 
Is also able to transmit voice on the voice diannel of 
one call and to concurrenUy receive voice on tte voice 
channd of tiie Other caB. Further. Uie user Is able to so 
reec^ votee concurrentty on the voice chanrtels of 
both of ttw first and second caDs. 

In attirthermethod of the invention, Uie network 
provides a first cdl among a fbst set of us^ stations 
and a second caH among a setxM set of user sta- 55 
tions. At least one user ^saion, which is a member of 
boBl of file fir^ and second indudes a display. 
RepiBsenta&xi conBspondlng to fte fir^ set of user 



stations art d^yed in afirstwindowft»-the first call, 
and concurrenliy. representations con«spondhig to 
the secomi s« of usw st^ons are disjasyed dis- 
played in a second whdowfor ttie second cal. A mw 
may rerard a first caD while communicatir^ on a sec- 
ond caU. 

Piawing ttecrfjrtlon 

FIG. 1 ^ a diagram illu^Fating the merger of two, 

mqtfK^nel caBs into a sirigle caB; 

RG. 2 is a diagram iflustrating the splitting of a 

stngte, imMthChanne! caB into two calls; 

FIG.3lsad!agram of a multicast packet switching 

n^wtak; 

FIG. 4 is a diagram of an individual multicast 
packet switch in the network of Fia 3; 
FIG. 5 is a diagram Blustrating a strong padc^ 
sequencing conditton; 

FiG. 6 is a diagram illustrating tiie packet switch- 
ing process for a multicast connection ttaough a 
nttdScast packet switch; 

FIG. 7a-4^G. 7c BIustratB three data packetflow 
patterns wittiin « muttiGast packet switdi; 
FIG. 8a-RG. 8d are diagrams used In desoibing 
propo^ of data packetflow patiBms; 
FIG. 9a-FIG. 9c and FIG. lOa-FIG. 10b are diag- 
rams used in describing proparties of vanila mul- 
ticast connections; 

FiG.11a-RG.11c are diagrams used in describ- 
ing properties of strong multicast connections; 
FIG. 12 and FIG. 13 are diagrams of two mul- 
timedia conferem^ anar^i@nients (tiie FIG. 13 
arrangement is a particulaf ecemplary «nbodi- 
ment. referred to herein as coitiierenoe sy^ 
100Q, whtah implements Blostrative multiple call 
control mothods of the invention); 
FIG. 14 Biustrates tite use of the connector and 
tije virtual <arouit in sharing a character-based 
application program; 

FIG. 15 illustrates the sharing of a gra^ical pro- 
gram by two parties; 

FIG. 1 6-RG. 24 illustrate various menus, wdndow 
and fcons for effecting contSHrence csdis and 
merging and splittir^ operations in accwdaice 
wttiausertaiterlaceforthecQnfapenGing anange- 
menttfFl6.13;and 

FiG. 25 musttatas a lwoi>hase protocol used for 
merging and splitting multichannel caBs in the 
conferencing arrangement of RG. 13. 

Petaiied Descriphon 

Mulfic^t ConnectloBs 

FIG. 3 shows a multicast packet switching net- 
work whii* cons^ <rf multicast paotet swntches 
(MP&) and netwwk mtertaces ps). 
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To achieve high-speed transmfesion, 8ie rmflfi- 
castpadcetswitdiing networlc is based on fast padcet 
techmdogy {desOTbed in J.J. Degan et al., "Fast 
Padcet Technology for hOsaes Switches", AT&T 
Tedwfcal Journal. V d. 68. No^, p. 3&^, 1@8S).hav- 
Ing the following attributes: (a) Unk-by-Iink emor and 
flow control is eliminated. ITius, &ie required field in 
the data link header Is ftn-fte logical chann^ nuBib«- 
(LCN). which Is used for rouSng pactets through the 
muiUcast packet switching network. An LCN for each 
iinkvnthin a connection is decided at connexion setup 
Bme; (b) Edge-to-edge eiror control can be incorpo- 
rated wthin tiie multicast padcetswitching network on 
a per-connet^ion basi^ and (c) The multicast packet 
switching netwoik provkies internal connedion-orien- 
ted servtees thatsupporthigh-bandwidth applicafions 
very effkitenfly. In such networks, the required link 
bandwidth and the end-io-end delay for a multicast 
application are independent of the nunAer of users. 
Also, the network performance will not degrade as the 
number of users increases. These advantages pro- 
vide a solid foundation for the multicast packet switch- 
ing netwfflSk as a vehicle for supporting various 
multksast applfcattons, especially, interactive mul- 
timedia multi-party conferendng. 

A multicast packet swtch is composed of a switch 
fobric a swftcb processor, and switch interfaces (Sis), 
as shown in FIG. 4. The switdi falirfe Is capable of 
duplicafing an incondng packet and routing the copi% 
to desired ou^oing ports. An exemplaiy multicast 
packet switch is disclosed In flie US. patent appli- 
cation tCT. Toaslinna et al., soiai number 
07/412.952. assigned to the assignee of the ixesent 
htveitfiOR. 

Pe^ltenZljt Whilh nviftipleinputstreEHnseach 
destnned to mul^>Ie outputs, a switch fabric said to 
have 

a. the weak sequendng (WS) property, if it only 
guarantees point-to^joint sequential transfer 
fh)m each input pcxt to any of its output ports; or 

b. the strong sequencir^ (SS) proper^, if those 
output ports receiving two or more common 
inputs have identical ititerieaved packet streams 
with respect to the pactet streams frtxn the com- 
mon input ports. For example, in FIG. 5, ttie two 
subsequences of outgoing pacjcet streams at 
switch interfaces D and E (orsvwtch interfaces E 
and F) containing and {q} {or{aJ and ^) are 
identical. 

A multicast pack^ switch will be represents as 
w-MPS (or s-MPS) if Hs swnteh fabric has tiie weak 
sequencing (or strong sequencing) pioper^. 

in general, diffoent linlei mrithin a midfica^ con- 
nei^on may use ^Mec&it UHto. Ttnis, each switch 
lnterf8K» m^ntsdns a padc^ transte&m tatrie (PTT) 
and a multicast conM table ^GT) to store routing 
Hifonnation about ffK)% mtdtfoast coni^dions. Eactt 
enby of a pad^ tran^on teMe, sidexed bf an 



incxxning IjCN, conjoins a multicast connection num- 
bst (MCN) and a swib^ header. ^ tiie incoming link, 
the MOM fieM stores tiie MCN a$s!gned to a mulfio^ 
«mnedk>n during ccHinei^ setup, the switch 
5 header identifies a set of outgoing links invdved in a 
nndtkast connection, which is used for pad<et dupli- 
cation and routing through a switch fabric. Each entry 
of the multicast control table, indexed by a MCN, con- 
tains the LCN chosen for the outgoing link within a 
10 multicast connection. 

FIG. 6 illustrates the data packet switching pro- 
ems tiirough a multicast packet switch fora multicast 
csnnection. An incoming padcet accesses the packet 
trandatioi table by LCN a at swib^ inierfoce A. 
IS Svritdi interface A tii^ replaces LCN a in tiie padcet 
header by tiie stor^ MCN m and pri^nds the stc»«d 
swrftoh headerto tiie packetfor padcet duplication and 
routing. Eadi outgoing packet uses MCN m in its 
headerto access the multteast control table at tiie out- 
20 going switch interface and obtains an outgoing LCN. 
Switch interfece B and switch internee C then replace 
MCN m in the padcet header by LCN b and LCN c, re- 
spectively. Finally, tiie switdi header of each outgoing 
packetwill be stripped off atthe outgoing switch inter- 
ns face before it leaves. 

{Lemma 1]: Any ariiitrary data packetflowpattem 
(DPFP) wittiin a midticast packet switdi can be 
adiieved. 

<Proof^ Givm a Set of swtch Interfaces, witii an 
so LCN diosen for eadi switch InterliMje, it Is dear tt^^ 
tiie dtnedlon of data padcetflow amot^ tiiese switch 
iiti^ces can be contmtled fay vwrHlrig suitable bifor- 
maSon into tiielr padcet transiiErii&n t^i^ and multi- 
cast contrd tables. 
35 FIG. 7 llustrates three natural data packet flow 
patterns within a multicast packet swSdi: (a) point-to- 
multipoint, (b) pobit-to-multipoint with upstream 
capabHify. and (c) muftipoiit-to-multipoint. They wOl 
be referred to as pattem-1, pattem-2 and patteni-3 
40 data padi^ flow partis, respedively. 

Hie mosssor (FIG. 4} establishes arKi 
disconneds swRdied ind&ast oonnec^iofls across 
tfieinul&ast paek^SM^ing netwwk. 

A network interface (FIG. 3} provides an access 
45 point to the multicast pacjcet switehing network for 
various networks and equipments, e.g., userslations, 
connected to it It is responsible for protocd/speed 
conversion, packet assembly/disassembly, signaling, 
ete. It also provides an edge-to-edge flow/ertw con- 
so trd aan^ tiie multicast padcet swttching networic on 
8 peNSonnecfion basis. 

A sxinse-bss^ inulSGast roufingmetiwd is used 
to peribrm muttieast connect setup. This metiiod 
GBn be applied to bc/ii switched multicast connection 
65 s^p and imdfica^ connectionless padcetroufing. 
Fdr each nniltii^t padest suMi in tiie imtfttoast 
pack^ switdiing neteioric sevetai spannUig frees 
rooted at tiiis mutficset padcet swKdi are generated 
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A unique global tree number (Tl^ wflll be assigned for 
each tree. Based on these frees, mtd^cast mmg 
tables (MRTs) are established at eadi multicast 
packBt««dtDhd(skis nedworiclfiaiaibsatlen.'nieebeof 
the rmilticast nHitbig t^des d^i^ on the number of 
multicast pac!<et switches in the miifii^ padcet 
switching neiwoikand the numberof trees. ThMefore, 
a tradedf between tie number of trees and memory 
space required at each multicast packet sunfch is 
made. Tliese tables may be updated dynamksally. 
However, it should be done infrequenUy. The advan- 
tage of using multiple spannir^ trees is to provide 
altematB midticast loutes that tiie connecQon 
compdetkm raia can be iniproviKL Uilderftt^ 
ations, theconnec&xi rantrol ladtets^irestatdlshHig 
or disconnecfing a connwSfon progress forward from 
the source multicast padcet switch to the next desti- 
naiion multicast padcet switcHes. Th^ may need to 
erankback to file source muIUcast padcet SMritdi for 
finding alternate spanning trees when smne mulflcast 
packet switch belonging to tiie clwsen spannhg tree 
rejects the new connection setup fors(»t» reason. 

The basic connedkm setup proradiffe Is as ifol- 
lows. When a connecfion setup pacdffit arrives at the 
source multicast pac^ sw)tch» the swM processor 
chooses atree number, amcn^ aatt<tf fir^ tturibers 
whldi conespend to tiiose spanning tnaes rooted at 
this multicsHt padc^ switdi. based on a lead eharir^ 
m^Bwd. Based on the desfa'naiion set in the packet 
and the miJtkast routing talrfe indexed by the chosen 
global tree number, the switch processor checks if the 
appropriate necessary and sufficient conditions des- 
cribed in detail herein are met to determine whether 
the multicast connecticm that would be established 
woidd be usable to effect ccnnmunteation bi accord- 
ance with a specified transmission maHixand meeting 
a given packet secpiendng condition. If the check is 
positive, the switch processorfhen parilSoie fte des- 
Ohation set into severail subsets; each subset«^l use 
a diteinent outing link. By put&ig flie chosen tree 
numbar in the padatand maskir^g off aB other desti- 
nation addresses in the desfinatkm ^ exc^t those 
in the corresponding subset, a modifed copy ct toe 
original connection setup packeS. is then generated 
and sentto each desired outgoing Ib^ inaddifion. the 
switch processor will choose an avaBdjIe mulficast 
oonnectton number (MCN) and send signal padkete to 
update the translation tabtes in eaOt imKdved switiA 
interface. V»ien the modffied pacfcat readies toe next 
mmcaiA paOeA ewtdi, the awiteh processor uses 
the tree mimberln the pad®tfo indaxarmjMcast rout- 
ing table, does sonje necessary c^iedang, and then 
fijrther partitions ti» destination subset. This proced- 
ures repeats until! all the de^nations are reached. 

The concept of multicast connecttons is a natural 
extension of that of point-to-point connections. That 
is, a multicast connection is a logical ^odation 
among a setof nelwaicinterfacesoverwhich al pack- 



ets fdlownng the same route, need not carry complete 
d^niEdton addresses and attive in sequence. Based 
on difiifflrent requirements, four flavors of midticast 
connectons are defined over an arbitrary midticast 

5 pacdtet switehing network: vanilla multicast connec- 
tions (VMCs), n«ilticast^4rtual circajits (MVCs), strong 
multicat^ connections (SMCs) and strong mulficast 
vWual drctflts (SMVC^). ftougWy speaking, vanilla 
multicast connections and sinmg mulficast connec- 

io tions onV provide neiwork4^r connecfionKsriented 
senricas to ttie u^s, and pac^ loss is allawed. 
They depend on the usersf transport fe^er to execute 
enor control, if necessary. On ttie oUier hand, multi- 
cast vUusi diouits arKistroi^ nutticastvbtuai dieuas 

IS provide lidwoik-layer ^rtud circuit services to tiie 
uasrs, whidJ ensure rdiaWe packet transfer. Theref- 
ore, emar contrd in flie transport layer is not neces- 
say. 

FOur flavors <tf multteast connections are defined 
20 on a(^dk:subgrapi» of the graph representing a mul- 
ticast pack^ switching networics. Acydic subgraphs 
guaanteeihideadimuificastconnMtioncontains no 
loop and every padc^ vdl readi its d«is8oafion(s} in 
finite time and loiir dday. 
25 [Defini^n 3.1]: 

a. An arbitraiy multicast padcet switching netwoik 
is represented by a graph G = {S.E,L}. where S is 
the set of all multicast pac*et switches, E is llie 
set of all network interfaces, and L is the set of all 

30 links. 

b. G = {S, E, L} represents an acydic subgraph of 
G, which interconnects all rietwork interfaces in a 
subset 1 of E via a subset^S of S and a subset Z 
of L Any link I jn C cuts G into two disjoint sub- 

35 graphs^^andGw.Letl,uandl^betwodisjoint 
stmseis of E. whidr contain fiiose netwodc inter- 
laces In Qt^ and Gi^ respectively. 
CiEach nrtworicirtterliace cenlainsasendercom- 
pon«it<SC) and a recewer component (RC) ttiat 
40 sends and receives padcets. respectively. Let SC 
i and RC 1 represent the sender component and 
tile receiver component of network interface i. re- 
spectively. _ 
Consideran an arisHrary acydic subgraph G of G. 
45 According to Lenuna I, witii an LCN chosen for each 
swfitch interface, any artJitraiy data padcetflow 
wiUtNi «Bh mulficast packet swifdi in S can be 
achieved, liiterconneefion of tiKse individual data 
padffitflaw patterns via the links L constitutes a data 
50 packet flow pattern on G. The flow direction on each 
Hrdc Is d^rmhi^l by two indtvklual data pacdket flow 
paUiems at its ends. VfiUi a data paofcst flow pattern 
witiito ead! multicast padcet switches bebig exem- 
plified, Bnk 3 has a bldbecSond flow in FIG. 8(a) and 
55 a unltfiredional flow in FIG. 8{c). The conesponding 
transmission matrices are given in FIG. 8(b) and FIG. 
8(d). 

(Lemma 2]:Given a 6. any data padcet flow pat- 
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tem constructed on G has tiie Mowing properties: 

a. Only a ^ngle LCN is sesocMed wrifii each link 
InL 

b. The data iKido^flow pattemsafisili^ the weak 
sequenrang (WS) condiBon, fliat Is, polnt-to-point 
sequenSa! padcettrans^ftomanynetivDfklnta-- 
fice in E to each of its iscdKring netwtsk tnter- 
face{s} is guaranteed. 

<Proo>:{a) is dearslncB. during the constniction 
of adatapacketi!owpatt«nonG.act»nrnon LCN can 
be chosen ftur the two switch IniBrfsK»s at en<b of 
each link in L (b) holds sines each midflcast packet 
switch has at least the weakseqiffiiidng prop^. 

[Definition 3.2]: 

a Given a E the sending/iso^ng relaforship 
among M network Interfaces in 1 Is represented 
by a N-by-N transmission matrix: TM^. wha;e N 
is the number of network friterfaora in E TM(E)p,j] 
is 1 if RC j recehres packets from SC i, and 0 
otherwise. _ 
b. Given two subsets X and Y^f E, the submablx 
TM(X,Y) is obtained from TM(E) by retaining only 
those sender components in X and only those 
receiver ccmponenis in Y. Let TM(E|,g, Ei^ and 
TM(E|,d, Ei,n) be represented by TM,^.d and TMi^u. 
respectively. _ _ 

Given a data packet flow pattern on 6, at TM(E} 
can be easily oHMnsd by iiadrg iSaSa pad«et flows 
ftam ead) network InterEaee bi E 

By imposing (Sfferant reouinemei^ on data 
packet flow patterns on 6, four flavors of multicast 
conneetfans are defined. _ 

[Definifion 3.3]: Given a G, a data padcetflow pat- 
tern on G is a vanilia multicast connection, if it satisfies 
the moittcast condition: There exists at least one net- 
work interface in Eirom which the packet stream fe 
destined to two Or more n^(xk. interfaces in E. 
These network interlaces are r^erfed to as multicast 
sources (MSs). The representatbn VMCP) will be 
used to siKiw the relattondiip b^we^ a vanilia mtri- 
ticast connecQon and Hs associated G. 

Ttie multicast condition implies that: (1) At least 
one RHitticast packet switch In S w^l duplicate pad:- 
ets; and (2) The TM(E), obtained from any VMC{G). 
has at least one row containing two or more I's. From 
this point on, oitiy TMCEys having at least one row 
containing two or more I's are considered. Given a G. 
a TM(E} with the weak sequencing condition may not 
be satisfied by a VMC{G). _ 

[ITieorem 3.1]: Given a G, a TM(E) wHh tie 
sequencing conditton can be satisfied tiy a VMt^G), 
if and only if it has the fdlowing VMC fxofxit^. For any 
link I in U if TMi^ {<x TM|^ contairjs two or mc«e 
noiKiSid iQw^ these tow muss be tdenticsd. In (^er 
wQitis, ev«y smder component in 1^ (or%^ send- 
l»dce^ tote»c^\ffirconp>nente inEi4(or^ 
musthaveidentkiatde^a&nsuts^c^l^Xorl^,;). 
■<:Pro<*>: The sufBcfentcondiStm fe shown by omi- 



tradi^on. A^mne fiiat there exists a link i in L so fiiat 
dlferent non-zero km®. This impiies 
there sdst sender ccxnponents and % in ^.u 
SHid receiver ccHtiponents and e« In %^ sudi fliat 

5 Tl«({ei,e2},{e3,e4) is eiBier HG. S(a) or (b). in RG. 
9(a), SC e, sends padcets to both receiver compo- 
nent, ej and 64, and SC ej only to RC ej. In FIG. 9(b), 
SC ei only sends padcels to RC 63, and SC ez oniy to 
RC 64. Since G is an acyclic graph, there exists a MPS 

10 s in G|4 50 that packet flows firom^Cs e, and 62 will 
enter its switch interface A via link I, as shown in FIG. 
9(c), and packet flows destined to RCs ej and 64 will 
leave from switch interfaces B and C, respectively. 
With a single LCN associated with link t. padwts 

IS feom SOs and ez wflf have the S^e LCN In their 
headers when theyae sentoveriinkL Sincaona LCN 
only indexes one entry Tn the padcet translatton \sabie 
of switdi interface A, padcets virith flie same LCN can- 
not be duplicated and routed to difiSerent subsets of 

20 outgoing switch interfaces. Thereft^, the desired 
data packet flow pattern vrittiin MPS s to support the 
submatrices in RG. 9(aHi>), can not be adiieved. 
This implies that the TM(1} can not be implemented 
by any VMC(G). The abcwe conclusion is also true 

25 virtten TMwji contahs diflierent non-zero rows. 

Next flte necessary condition is proved. L£t Eu,i 
$nd Bun ^1 ^ ^ ^ ^ subsets of (or 
so fliatTMC^t. TM(Eta, M) contains 
an Ihe Vs in (df TUia^. The fiorffiSponding 

30 paci»t1k>wmoddteofTM(e4,t.EH,i}an^TM(Ej^2,E«4^ 
are shown in FIG. 10, in which MPSs s, and 82 bofii 
have paitenvl data packet flow patterns. Let LCN n 
be chosen for link I, then packets from each sender 
cOTiponentin and E^,, will use LCN n when they 

35 are sent wer link L To a<*iieve these two data packet 
flow patterns, i^ the reiuting field in the switch header 
entryof tie paskettranslaGon table atswitch intertece 
A (or SI B, rasp.), indexed by LCN n, identi^aset of 
ou^ng links from witich padcets are transmitted to 

4a the receiver compment in E«,i (or E^^. 

Three nature vanilla multtcase connections over 
the nwlticast padcet switching network are given 
bekw. 

a. Point-to-multipoint (Pattem-1): Thepe is only 
45 one multk^st source and each multifsast paedket 
switdi in ihe vanilla mul&ast connecfion \m pat- 
tem-1 data packet flow pattern, 
fa. Point-to-muifipoint with upstream capabiiify 
(Paltem-2): There te only one muIBcaste source 
50 and each muttica^ packet switch in the vanilla 
midficast Gonnectkxi has pattm-2 data packet 
flowpaUem. 

0. MiMpc^rft-bHnultipofait^^artiKTi-3): In this vant- 
fta multk»st connection, each networic internee 
s a multicast source and each multicast packet 
has pattsm-3 data padcetflow pattern. 
M^data api^i^ns requrerdiable ccHiimuni- 
catton. To pnadde a netwcrte*^ edge4o-edge rdt- 
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able service to ttK»0 mySoa^ appncaQpi^ th^ 
requite cotnj^^y etiw-#Be trai^i^on and Bisrtdo 
not employ some higher-layer errcr control protocol, 
the multicast \nrtuai circuit is introduced. 

IDefiniBon 3.4]: A muitfeast virtual cteua isavanl- 
lla nudtlcast oormectiOH viAldi also ^rSsfies ttie n^i> 
able condMon: Pdbitto-pdntrar^Ierpfiuik^lraBsfe 
ftom any ndwokinterfecefoeac^c^itBreceivbig n^- 
work interfaces is guaranteed. 

There are two issues associated with a irailticast 
virtual circuit. 

1. Since a vanilla multicast connec^n may have 
multiple senders, a muliipoirit-to-inuliipoint enw 
rontroi protocol muM be exndsed ammg all n^- 
workinterfoces._ 

2. @hren a TMp the vanflla mutticast con- 
nection properttes. a VliK^^^ can be up to 
meet the de^ infonn^ ftofv ralaBansKp 
among usans. However, thte VM^^ Is oidy con- 
cerned with transmission of data (or Informatkm) 
padcets. and there may not odst pain ki it for 
retomirjg acknowledgements (ACKs). 

One approach to address ttte second isaie is 
described bdow. If the VMC(^of agiven TM(^ also 
providespathsforreturning aclcnowledgements, itwia 
be used to fransnit both ^ and adcnowledge- 
mm. Oflierwise, a TM'(E) is obtained. wha« 
TW^jrai te 1 if TMClDjl or TM(i)D.n is 1. If the 
Tiie^ still has ttie vanlla iruifticsst connecfion 
l»opertlB8*aflewVMC(^isthensetuptosupportttie 
desired Information flow retefionship represented by 
the TM(I) and provide nece^ary acknowledgement 
paths. In both cases, some n^woiic interfaces may 
receive undesired data packete and/or adoiowiedge- 
ments. Therefore, two address fields-the aldresses 
of file sending network int«rfe<» and a» HsCeivIng 
network Interface-are reserved in the error control 
header so that each network inteii^Ge can discard 
undesired kicming packets. Theeecondfi^d bused 
only by the adoioudedgemenls. 

A vartDla multteast connection and a multicaat vir- 
tual drcuit are not eoncaned with ihe sequendng 
raiatldnship txtass multiple soiders. Although most 
midticast aj^kattons can be supported by a vanilla 
multicast connection or a multicast virfaial drcuit. 
some multicsBt applications may request the multi- 
cast packet svi«ching netwoik to provide a nwlticast 
service whteh maintains the sequendng rdatk>r»hip 
across multiple senders. A ^ng multicast coimao- 
tion and a strong mulficast virtual (drcuit s»e intro- 
duced to provide a networic-based strongsequendng 
mechanian to those miafieast applfcsitons ttiat 
r^uiie^ng s»]tmnfial iransRdssk>nandfi»tdonot 
employ sorrte higher-layer *0fts sa^enang pro- 
toobl. 

[Delinitkm 3.^ A AffiuitIa multicast connection is 
a strota milBoa^ connecaon. if it also satisfies the 
strorig se<p«idng (S^ condffion: ttie setprence of 



padket streams aniving at a s^of ntiwQik Merfaces 
wiUi two or more common nwfflcast sources are Wen- 
m vMi ts^cttp the input streams ftom common 
imjflcaist source 

5 To invesSgateliie relationship between transmis- 
skm matrices the ^ng sequencing condition 
and strong multicast connections, consider those 
transmission matrices which have the vanilia multi- 
cast connection properties stated in Theorem 3.1 and 

10 can be implemented by a vanilla multicast connecBoa 
[Definition 3.6]: 

a. Giwen a msrtitc, its two cdlumns (or two rows) 
aand ^ are said to be coupled, if column (orrcw) 
acontainsatleasttwb 1's atfiiesamerow(arcol- 

f 5 umn) positkm as column (or rowO p. 

b. A matrix with at least two coupled columns is 
said to have the strong coupling property, if ite col- 
umns (or rows) can not be partitioned into two dis- 
joint subsets such that there exists one cdumn 

20 (orrow)ineachsubsetfflidthesetwocolumn8(or 
rows) are coupled. 

o. A TO(E) having 8»e vanilla mdficast conneo- 
tton propffl^^ and al l«Btlj«> coupled columns is 
called a coupled transmis^ niatrbc represented 
25 asCTMl^. 

it Is dear^ for each non-Cm(^ witti ttie vani- 
lla RHdttoast oonneceon property, its associated 
VMG(©) feji moifSi. From this point an, consWer 
only cnW(E)s. The problem Is sioranarized brfow. 
30 [Probiem3.1]:GivenaCTM^,fmdthe8ufficient 
and necessary condition such tttftt tts assotiated 
VMC(G)isaIsoaSll/iqG). 

Based on Definition 3.5. the strategy to siolve 
Problem 3.1 istofindoutalithosesubs^ofreceiver 
35 components wrfildi have resf»otivB b«o or imwe cran- 
mon sender conponenis and then check the strong 
sequencbtg condlfion fbr eadi subs^ sepa^. By 
using thefolkjwing parttfon method, a CTM(D can be 
parfittoned into a number of submatrices virtiich have 
40 either no coupling property or the strong coujrfing 
proper^. Each submatrbc corresponds to a partial 
padketflowof the associated VMC(G). 

[CTM(^ Parfflon Method]: Let C_be initialhisd to 
indude dl the columns of ttie CTM(E). The disjoint 
45 subsets {Ci j=0, ... m(>=1)} of C can be generated 
ftom the fdtowng steps as C shrinks to an empty set 
Assume that the subsets Q, ... C^^ are already 
non-emply and the subset Cj is empty. 
Stapl: 

50 If C contains only one cdumn, then move the 
remaining Cdumn ftom C to Co. In any case, stop 
if C IS ranpty. Otherwise go to Step 2. 
Step 2: 

Find a cdumn witti the laigest number «rf Vs. say 
55 c, from C. Move cfifomC to Q. 
Step 3: 

For each column c in C, repeat the following pro- 
cedure: 
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{if there exi^ a edumn in so that tti^ two 
cotumns ha® the coufrfing pnoper^, tlteninove c 
ftofflCtoC|.} 

Slep4: ^ ^ 

If C| contains only c, then move c fimm Cj to Q,. 

GobadktoStepl. 

Let Erj be ttie set of receiver ctxnponenis cwre- 
sponding to those coiumns in Cj. Clearly, Er^ .., E,,™ 
are<lisjoinL 

By using similar steps as those above, tiie rows 
of each submatrix TM(E, Efj). I^jsm, can be par- 
tilioned info a^number of disjoint subsets i = 0, .., 
n ^1)}. Let E,,i represent the set of sender compo- 
nents corresponding to the rows in R( and TMij repre- 
sent the subnetrix TM(E|j,^j). Gearty, Et^, ~, 
aredtejoint 

Co and Ro may be empty; however, Ci and Ri 
always odst by the definition of c™(E). Based on 
Definiflon 3.5, it is dear that the strong sequencing 
condition of the CTM{E) is satisfied , if and only if the 
strong sequencing condition of each submatrix 
obtained in the partition algorithm is satisfied. Since 
TM(E,^,o> and TMoj, 1^Sm, if they exist, do not have 
the coupling property, the packetfiows corresponding 
to these submatrices are ignw^ while the strnis 
sequencing condition of 8ie CTM{E} is checked. How- 
em, each TMu. ls^. 1£^. has the strong cou- 
pUr^ property. Th«r6^« to di^ vvfth Ptt^em 3,1. 
eon^r fliese l^an, and deal wSh 

fiteir strpng :se(]uendn9 concfiHons sepBiateily. Note 
that each 1M^ has the vanilla Rtulticast connection 
property since the CTM(E) does. D^endlng on the 
type of multicast padist switch^ the sufficient and 
necessary condifon that the strong segueni^g con- 
dition of a TMy can be satisfied ^1 be different The 
following definition is needed for describing flie main 
results which are summarized in Theorem 3.2 and 
Theorem 3.3. _ 

[Definition 3.7]: Any link 1 in L cuts G into two dis- 
joint subgraphs G|,u and G|^. Let E^y,^ and E,,y^ con- 
tain those sender components in Gj^ and G|_d, 
respectively. Also let Eij4,u and Erjj,^ contain those 
receiver components in Gi,u and respectively. 

[Theorem 32]: Assume all the multicast packet 
swrftches are w-MPSs. For any given TMy, 1^ai, 
l£j^ 'is strong sequencing condition can be satis- 
fied, if and only if, there exists an infer-MPS iii& In L 
such that if all the senderoomponenis in ^ are in ^ 
or (G,^, thenjili fiie receiver c6R)poneitts&) must 
beinGi^(orG|,o). 

<ProQf>: Since w-MPSs only have the weak 
sequencing property, it is dear fliat Bie strong 
sequencing condlOon anung the receiver compo- 
nents in %i can be saSsfted if and only if these 
recover component receive packets via a single link, 
wheta all packetstreams originating firontiie sender 
componiEsits in E.^ are mtdtii^exed into a slr^e inter- 
leaved padcet strefflti. in this {»se, the value of eadi 



element in TlWy is 1 , since TMy has the vanilla multi- 
tssA cQiinec^dR {xoperty and tie stror^ angling 
pnopMty. 

[Theorem 3.S^ A^me all iOie mui&ast padcet 

s sw^dies are s4ijiPSs. For any given TM|j,l£i£n, 
li^jsm, its strong sequencing condition can be satis- 
fted, if and orty if, for any inter-IWlPS link I in L, there 
do not ffidst a sends- component and a receiver c(»n- 
ponantin G|,„ and asendercomponentand a receiver 

10 component in G|^ such that these two receiver com- 
ponents have these two sender component as com- 
mon multicast sources. In other words, there dp not 
exist four respective non-empty subsets, say Ea,ij,u, 
E»Ai,*_Erjiu and E^jj^, of the sets E,,,^ E,,i,|^, 

15 and ErjAdi such Siat the value of each dement in 
TM(4,u>EMw}.{ijj,u,irjj.d})is1. 

<Prod>: When the sendw components inl^i and 
the reo^r components in E^j are connected to tiie 
same imilticast packet switch, the claim Is fiue since 

20 the s^PS has the strong sequencing property. 
Therefore. K sufficesto prove the case when the sen- 
der components in E^i and the receiver components 
in are connected to the same multicast packet 
switches. Since l^y has the vanilla mulb'cast connec- 

25 tion pn^eiQes. FI6. 1 1(a} depicts an equivalent two- 
MPS model wiih respect to eadi &itar-MPS link I. 
Multicast p9titet swlbil»s 1 «nd 2 reprint the ^ 
mul)i(isiSt|Mid«^ swftdies ii^ich link I eotinects. The 
sender components fn Ei,H u and the receiver compo- 
se nents in Eiyg^ sve c(Htnected to mulficast packet 
swtch 1 , and file sender compbhehts in Enf)^ and the 
receiver components in Erjj^ are connected to multi- 
cast padtet switch 2. 

The packet flow model corresponding to TM(^j, 

35 Erjija) shovm in FIG.11(b). This is equivalentto the 
case that the sender components in l^j and the 
recehra- components in Erjj,u are all connected to mul- 
tilist packet switch 1, and therefore, the strong 
sequendng condition among the receiver compo- 

40 nents In Efjj,„ with respect to the common sender 
components in E,^ is satisfied. SimOarfy, by removing 
Etj^ifi and ^^.y^ from FIG. 11(a), respedlvety, 
the strong sequendng condition among Ihe receiver 
components in Er^i^ with respect to the common sen- 

45 der components in E,,,, the strong sequencing condi- 
tion among the receiver components in li.j_with 
respect to the common sender components in E,jj,u, 
and the strong sequendng condition among the 
recehfer components in E^j with respect to the com- 

so mon sender components In E^i;^ are also safis^d. 
Therefore, the only remaining case to chedc is when 
there ejdste at least one element in each of fbiff sets 
— E,.M.» ^•AW' ^jJiu ^"'^ ^y>u< sudi tttat these 
receiver component have these sender components 

S5 as common multicast sources. 

TTie necessaiy condition is proved first For any 
inter-4MPS Onkl in L, suppese there do not exista bin- 
der component and a receiver component fii and 
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a sender component and receiver conpiHient in Gi^ 
such SiaJ these two receiver coinponMrts have ftese 
tm sender emptxmfs as cpmmon i™a&as* aKjr- 
ces. This inq^iss ihatthe above twiaUii^ case does 
not exist Thasfere, the sbom seepjencii^ condifiaj 
of the TOy is satisfed. Next, »ie suffidart craidition 
is faoved by contradiction. ConsidCT FIG. 11(c), in 
which sender component A. sender component B, 
receiver component C and receiver component D are 
in Efjj^ and Irii^, respecfivdy, and sen- 

der components A and B are common multicast sour- 
ces to receiver components C and D. If each of saider 
componaite A and B sends a padtet receivw compo- 
nents C and D at the same time, then receiver com- 
ponent C (or receiver component D) vi^l recefve B>e 
pactet fsm sender component A (or sender compo- 
nent B) first Therelbre, receivercanponentsCand D 
win not iteoeive Identical interleaved paclet stjeams. 

Pefinition 3.SI: A stronta multicast virtual circuit Is 
strong mulUoast connection which aiso satisfies the 
reliable condltiom a set of netwoik interlaces with two 
or more common mulficast sources will receive iden- 
tical intoleaved padtet streams with respect to the 
input streams ftom common mulficast sources. 

By execuar^ raulfidesfinaBon enor auini 
mnm ^ netwoik intHfiaces in a sirong nfeiHicaBt 
connection, some retransmits paciestB m^ exist 
VWthout other ir»ane, eadi rBceiwer component may 
put an original padcet and a retransntitted padtet 
craning fiom different multicast sources into different 
OKier, and the strong sequencing condition is viol- 
ated. To solve this problem, each paclcet in a sb^ong 
multicast virtual drcuit canies a global time stamp. 
Time-stamp ordering assures that the strong 
sequendng condiHon among all the recehrer cotipo- 
nents in a strong nwlficast viHuid dffiuit is saMed. 

Various flavors of mtdiiGast cnmedBons pronde 
various Idntte of nmlticast services to useis. A midS- 
castai^icatkin (MA) is an etid^sei's usefbra mul- 
ficast service or a cdlection of muNcast serviees. To 
achieve service integrafion, a multicast appife^on is 
viewed by the users as an integrated service. 

The single-media multicast applications, such as 
multi-destination file transfer, voice conferencing, etc, 
are generally supported by a suitable flavor of multi- 
oast connection. However, for those nwltimedia mul- 
ticast appllcafons (MMAs) involving two or more 
media, they may or may not be supported by a argle 
midfieast eonnecSon. Consider a multiiDar^ interac- 
th« debugger. Two diffisrent scenarios ae shown in 
FIG. 12 and RG. 13. respecfoely. Eadi nuiBmetfei 
W0rtc^alk»«(l«lMWS)containsafenninal(e.g.T1)and 
a voice tnidge (VB) and is connected to a separate 
nrtwotkiiHfirfece.lnRG. 12. the editor program used 
for file debugging is a netwoilc server in an ifrtelligent 
server node (ISN). MultitHe mulBsBtconnetfflons are 
used. The dashed lines irterooniwcting fee edaorpro- 
gram arrf the ttiree termaiids represrait a patem-2 



multicast virtuai dnafitwah the InteB*^ server node 
as the imdtieastsouree; Sie ctoasd lines Intraconnect- 
ing tiielftree voice bridges represent a patlBm-3 vani- 
lla miMcastconnecfkai, In RG.13, the editor program 

5 resktes In mtdtinndia wKstetafion 1. As before, the 
users can request multiple multicast connections to 
support the nsiltimedia multicast applicaBons; or an 
alternative, the users may request a single patlem-3 
vanilla multicast connection for both data and voice. 

10 The latter results in a multimedia multicast connec- 
tion, in which two media share the same logiiaal chan- 
nel numberand are distinguished by different channd 
numbers, its advantage Is that the connection setup 
'B dona only onoe. Since the data are also sent via the 

IS paltem-3 vanilla iwilficast connection, multimedia 
woitetation 3 (or multimedia wortetafion 2) needs to 
dtecard those incoming editor-program-destined 
editor commands generated at multimedia wori®- 
tation 2 (or multimedia worltstation 3). This data- 

20 padcet-discarding is effidently implemented in 
hardware. Multidestination enor control for reliable 
data Is executed atthe mulflmedia woricstafions rather 
than file netwo* interfaces. The voice sharing the 
same multica^ connection virlth ftie other media 

25 shows ail advantage of using distributed voice 
bridges. 

In summay. the nimib»^ of multicast connections 
needed to sumxHft a g'wen midflmedia multicast appli- 
cation generaJly depends en the location of servers 

30 and thefcrdalionshlps. For the local servers, audi as 
the edftw progiam and 8ie voice bridges in FIG. 13, 
residing in the multimedia woricstations, a single mul- 
ticast connecfion or midfipie mulficast connedions 
can be requested to support: the communicafion 

35 amongthem.F<MrthenehiwriC8efveis,residingSrithe 
networic interfiaces or ths intelligent servw nodes, 
thenr iaca&ms are generafly transparent to the users. 
TheiBfoie. the u8«s may need to request a separate 
mulficast connection for eadi imtependentnetwoik- 

40 based serwce. 

Multimedia Conferencing 

The description of multimedia conferendng 
4S Which follovre is based on one p»tfcular exemplary 
etrAodiment, refenBd to herein as conferencesystKn 
lOOO.showm inthed^pfamdfRQ.13.C?ompui»rsup- 
port for group wwit can primariy address eittier 
asynchron'tzation interaction or simultaneous (real- 
so time) iiifsractkin among users. Bectronic man is an 
example vi*idi primarily addresses asynchronization 
interacfion aarrwng users. Such systems are most use- 
ful when each user works according to thear own 
sdiedule. For some sajafions. iike crisis handling, 
» real-time interacfion fe essential and more productive. 
In a reaWime ocanputo" based confisrenoB. people can 
share informafion simultaneoudy through th* per- 
sonal comiaitas. The recant adwncements fei Wgh 
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Speed nc^iks and high perfornBnce vmrkstaSons 
mate K easier forisors to hanre tsd%os ipAQmedia 
axnmunlcations. The medhmi can be voiee, Intaiao- 
five daia, image and videa 

There are several exi^'ng reat-tnne cxmference 
systems. Some of them, e.g. as disposed in L Agul- 
lar, et al, 'Architecture for a Multimedia Telecon- 
ferencing System," Proceedings ACM SIGCOMM'86 
Symposium, August, 1986, H. C. Forsdick, 'Explor- 
aBons in Real-Time Multimedia Conferencing," Pro- 
ceedings of tfie &td International Symposium on 
Computer Message Systans, iFTP, September, 1985, 
A, P<^lo, et si, "COWS A Computer-Based, Mul- 
&nedia informafion System,* Computar 18. 10, 
October 1985, are constructed as spedaliiBd prog- 
rams di^ributed among the conferees' oomputers. 
GeneraPy these specialized programs can not invdce 
Other appFicafions. Consequently, fwre-exisfing appli- 
cation programs had not to be mod rfied for each con- 
ference system. 

Conference system 1000 (FIG. 13) and a few 
ofiiersystems, e.g. as disdosed in KA Lantz, "An Ex- 
periment in Integrated Mul^media Conferencing", 
Pnx»ed|ngs of the Conference on Computer-Suppor- 
ted Cflopetaaitfe Worl<'86. December, 1986. S.R. 
Ahuja, dJL Ensor, and D.N. i^om, The Fttpport Mul- 
timedia Confierencing System." Proceedings of Coft- 
fiBrencB on Offfce Intewialion Sy^wris, l/lareh, 1988. 
dlow any pre«dstBig applicafions. wiitlen for a sin- 
gle^iser environment, to be invoked fittti the within 
firamfrwofkof a conference. These preexisting appli- 
cations, which produce useful data to a collatraration, 
can be invoiced without modifications. These systems 
also diow programmers to develop typical appli- 
cations without having to deal explidfly with the con- 
ference issues. 

Another chara(^erisSc of conference ^stem 
1000 Is that K is based v(m fast pactet network 
technology. The transp<»t layer and netwoik i^r 
software in system 1000 can support rnidtnnedia 
padsts (vtrice. data and image) going ttirough a 
single padcet netwoik and can presove temporal 
^chronization among diffowtt media. Temporal 
synchronization is important for real-fime multimedia 
communicafion. For example, a conferee may high- 
light different parts of a text file sequentially vMe 
maldn^ yoic» comments on highl^hted texLThe high- 
lighted text and the voice comments rfiodd appear 
synchronously atail conference wortetatkHis.%stan 
1000 can also record voice and data into anwKimedia 
file with temporal ^nchronlsaUpn {Hi^eived. The 
recorded Ue can be renriewed by a iser a^chron- 
ously m played bade In a resU^hfie conf(E»ienee. Voice 
annotaSon on a recorded file is also suppcnled an sys- 
tem 1000. A userm^ recotd a fksi caD whBe com- 
inunicafing on a second csi. 

in addi&in to involdng pre-ffl^tirig ai^icailons 
and receding a conference, system KKK) also sup- 



ports changing conference configuiations dynami- 
cally. A GonfeFence has two l)asic elenmits: con- 
ferees and shared applicaUons. A conference 
configuration is changed by dian^r^ these two ele- 

s ments. In syrfem 1000, a woricstetion may have mul- 
tiple conferences at one time. A conference 
configuration can be changed by adding or deleting 
applications to a conference dynamically. K can also 
be changed by merging two conferences into one con- 
ic ference or splitting a single conference into two con- 
ferences. Thus, the confenses in the resulting 
conference are changed. 

Usually when an applicatbn is invoked in a con- 
ference, it should be shared by all confnees in ttiat 

f 5 conference. Bi& In sor» a'rtuafions, it m«y be desir- 
able to restrict parficidar conferees fiam accessing 
%e shared application 6aa (^ther |npui&ig com^ 
mands or seeing outputs). The ability to change the 
conference configuration and the abiiify to control 

20 access to applications greatly increase file ftocSiility 
of real-time desktop conferences. 

in the description which follows, a graphical user 
interface (Ui) is presented which allows users to per- 
form these conference functions: s^ng up a eonfer- 

1^ ence, adding (a'deleb'ng)applicati6na, oontialiii^ the 
access to an application, recording a oonfarenca, and 
moiging (ix splitting} conferences. 

The spai^ical vser interikce is based (Hi an 
impoitantidea^e confeiBntje rocmtncitkMir Aconlisr- 

30 ence room is wrtiere the conferees meet and see ttia 
shared applica^. If an appHcation is moved into the 
conference room, it will be seen and be used by the 
conferees inside the room. If an application is moved 
out of the room, it will no longer be shared by the con- 

35 ferees. The configuration of a conference is the con- 
tents of the ro<»n; the conferees In the room and the 
sqiplicafions in the mom. Par any conference, there 
tttu^ be some luies c()ncernirig «Aio can spasft when, 
who has access to aenaawa data, etc TMalsjcaiiBir^ 

40 to as access oontroL Ccmfisses and ai^te^His in 
one room rn^y be momi to rneigeiirith anolh^ 
to form a joiiA oonferencaL A joint Mnference tmsy t>e 
sfM bito two separata conferences. In thefoNowing, 
basic mecihanisms for setting up a conference and an 

45 application are described first The use of mantis and 
buttons in the UI to perfomt various confemiee&no- 
tions is then described in detel. 

in confererKe system 1000, ttie multimedia vir- 
toal cimuit, as disclosed in U.S. Patent 4,905,231, 

so fesuedtoW.F.IjBurQetai.onFebnjaiy27, 1990, and 
in WJP. imm. &,W.IUitdarer, MJ. Metgrn, 
Ftoberts, and S.C. Tu, *A Set <rf Operating System 
Mei^iardans to Suf^Ktrt Multimedia /^i^k^ations," 
Rmceedirgs of 1988 International Zm\<Ai Seminar on 

ss DigHd Communications, Mardi 1988. provides net- 
woik layer and transport layer interfeces to tiie ses- 
sk>n \ag&. One impoctent chaacteristic of the 
multimedia w'rtoai circuit is that sl\ of tha media invol- 
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ved in a call are multiplexed into aslngle vMial drcuit 
The network layer deals wt^ the multimedia virtual 
circuit as a whole. In ttietransportlayer, the virtual ch'- 
cuit is divided into multipie channels, where each 
channel transports one m^iuin. The primary objec- 
five of multiplexing mulfiple channels into a virtual cir- 
cuit is to provide temporal synchronization and 
coordination for a multimedia call. 

In systsm 1000, each conference has one virtual 
circuit connection. To create a conference, the 
sion layer software first creates a multicast (orpoint- 
to-poinf) virtual drcuitto connect to remote ranfeiees. 
The newly created virtual circuit has one signalling 
channel. The session layer uses this signalling chan- 
nel to negotiate wili) its counterparts to agree on the 
successive chann^ and applications. In system 
1000, one channel Is dedicated to one appiicatkm. 
Miith'ple appUeatbns (chEUinels} can be created fcr a 
conference. The phone devtee is treated as an appli- 
cation in Uie conference model. Data applications can 
be one of the three types: the traditional character-ba- 
sed application programs, the X-based graphical 
based programs and specN conference programs. 

For iradiUonal character-based applica&ms pro- 
grams, sudi as ksh, adriverrefmedtoasaconneciDr 
(dlsGki^ in W.F. Uung, (3.W.R. Luderer. M J. Mor- 
gan, fJR. RobeifB, arid S.C. tu, ' Asetof dperaOng 
System Mechanisms to Suniort Mdfimedia Appli- 
cations, Vnoeedings of 1988 in^^ 
Seminar on PIgilalCQmiaunlcaBons. Mardii 1^). Is 
used fer interprocess oommnnicatim. It provides 
fl&dbls iDi«m»nheciiiyil^ ttiat m muWcast data from 
a soiovBlo severed selected destinafians and concen- 
trate <Eaia from s8yeralsourc88taa«^ngle destination. 
FIG. 14 Wuslratesfie use ctf flie connectorand the vir- 
tual dixiuit in sharing a character-itased application 
program (bln/ksh) by two parties. The prc«sss devp Is 
needed fbr transferring a characf^ stream between 
drivers, itisimportantfo notethatonVonecopy of the 
program is executed po^applici^ shared by a con- 
ference. This in^ementaBwi of sharing chsradter-la- 
sed applications allows all parSes to input commands 
to the E^jpiicatlon simultaneoulsy. 

In addition to tradfflonal character-based appli- 
cations, graphical applications based on the X win- 
dowing system (disclosed in R. W. Scheifler, and J. 
Gettys, "The X Window System," ACM Transactions 
on Graphics. AprS, 1986), can also be invt*^ in <Hir 
confianence systo without modrunifions. FIG. IS 
illuSrates the «l«u1i^ ofa graplftia! |»ogiam xprog by 
two parties. Ti» X window seivers and jquog are 
unnmdilied.Tl»p8eudoseivBrperformsnecessaiyX 
resource identfflar trat^edkm. The pseudo servers at 
the stations w^ldi do notninttei^i^ieadan program 
perform the translation. Pseudo serrors ateo conbol 
the flow of X events iirom X servers to the applica^on 
program. Unlike the Implementation of character-ba- 
sed ai;q>Iic^ns, tins knplennent^ on^aflows one 



party to Biput at a ftne. If party 2 has the control to 
input, then the pseudo server will take the event 
str^ only from paify 2 mi feed ft to the aptdkation 

5 Dataapi^katton programs designedapedallyfar 
cdlaborative work can also be integrated into system 
1 000 as long as ttiey use the X windovwng system and 
the multtmedia virtual circuit as the transput vehide. 
As an example, a cut-pa^e program in system 1000 

10 allows conferees to share images irom workstation 
displays. When a cut-paste applicaOon is created, 
each stab'on runs a (»{^ a me cut-paste program. 

Voks ^plicationfi (phone) are difliBientlnHn data 
applicaSons. Exceptor vobse recordir^. vofce padk- 

IS eisaretranan^toandiinmfiieinter^hardware 
direciiy without going ihnwgh the user space. 

As stated iiefote, one conference has one virtual 
circuK connectbn. A conference may have multiple 
conferees and multiple applications. To change a 

20 conference configuration, any conferee can dynami- 
cally add or delete an application. When an appli- 
cation is created for a conference, it is shared by all 
the conferees unless access right are restricted. In the 
present embodiment, two conferences can be 

25 merged into one conference. When two confisrences 
are metged, tun virtual circuits are roeiged into one 
Wrtual circuit Aconferenoe can be afeo be splittiwo 
amferencee such that each oonferenee has a eepa- 
tate virtual oteulL 




The merge operation entats combin'Hig tMro 
MMVCs (multimedia multicast virtual dnsuBs) into one 
35 MMVC (FIG. 1). The set of dcsfinaBon end polnte of 
the rssidting miNC is the unkm d'tha destinaSons in 
the two original MMVCs; after merging MMVC 3 and 
MMVC 9 the tasuitlrtg MMVC 12 has destinations A 
B, and C. 

40 Each oftheo^inal MMVCs contains one signal- 
ling channel plus other application channels (voice, 
data, or image). The resulting merged MMVC con- 
tains one signalling channel plus the sum of all appli- 
cation channds. That is, if X and Y are the numbers 

45 of application channels in two MMVCs to be merged, 
then Biere will be X + Y - 1 application channels in the 
resulting merged MMVC. FIG. 1 shows that wMks- 
lation B has a voice channel and a new date channel 
tiiatdidnot exfet beforettn meige^ and workstetion C 

fio hasanewdatedtenml. 

in me preserft embodtaent, a conference Is not 
allowed to hawe nwre than one phone. This issue 
arises when two conferences, each with ite own 
phMie, are merged. Atthe session layer, each confer- 

m enoa Is supported by one MMVC. Whan two confer- 
ences are merged, fteir corresponding MMVCs are 
merged at tiie transport layer. 

in aitemative embodknenfe. applications may 
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require multiple voice channels. Therefore, this issue 
is resolved at the session layer. It is the session 
layer's job to dose one of the voice channels after a 
merge of two MMVCs each containing a votes dian- 
net. Of course, ttie conferees need not be anvare of 5 
these detafls. To them only one phone appearii in the 
conference room after a merge, as is expected. 

When one MMVC is split into two MMVCs (RG. 
2} the session layer specifies the destination end 
points and the application channels that vtrili exist in io 
the resulting MMVCs. Each of the two resulting 
MMVCs virill have a subset of the original application 
channels plus one signalling channel and a subset of 
the original destination end points. It is further 
required that each destination end point be a member iS 
of at least one of the two resulting MMVCs. Similariy, 
each application (^annel ^uld appear in at least 
one of the two nesulting MMVCs. In other words, des- 
tInafiQn wJ pdnts ami channels cannot be dropped 
as part<^aie ^llt opemOon. 20 

The originator of a mergd Qperaticin Js required to 
be a member both MMVCs io be mei^ed. Sindlarly, 
the originator of a split opensftm is reauted to be a 
member bt^h of ttie lesultir^ MMVCs. 

25 

Usertnteiface 



There are three levels of windows presented to 
the conferees of a wortetation: Ul windows, rocmi win- 
dows and application windows. A Ul m'ndow has 
menus to (1) setup and tear down multipaity (or two 
parly) confierence calls, (IQ add, and delete appfi- 
cafions in a confisrence call, 0} msge and split con- 
ference calls, and (4) record a conference. 

There is a room window for each conference call 
from or to a wortetation. Each room window contains 
applications and conferees of a conference. Since a 
workstation may have multiple conferences, a room 
window provides a graphical view of eadi cnnference 
and its ccnnponents. Access control provided 
through a room window. 

There are applicatjon windcms which appli- 
cations create. UaiaOy an ap|dica6oH wbidow con- 
sists of a top |ey«^ window whidb oorfis^ other 
subwhidows jiRiide Hs boumfeiyi For each $9>piicatKffi 
in a conference, an apjdlealion window wB appear in 
eac^ station whidi pacScipates in ttiis conference^ 
The apftotton vrindow is the place where shared 
dafalipmapplicafions we displayed and is wrttereOie 
osmmands to the aps^icaOon are input. 

When U! starts to run, ltdoes tvro things: (1} starts 
a listen process to It^n to incoming call requests 
ton wher wortetatkxis, wd ^) displays a m^n 
mm to aocepA u^ commarafe^ Hie main menu is 
siKMmin the Fl<& 16. The main menu has two rows 
of coninand buttons and aliace icon whidi Idenfifles 
&e cortferee'sAiKHtc^&n. The buttons in tl« top raw 
represent opeiafions on conference rocxns and 



objects in conference rooms. An object may be an 
application or a conferee. The buttons in the second 
row are used to create objects (applications) in a 
room. The command buttons ftom left to right in the 
first row are: room button, qpit buttcm, record button, 
trash buitoni merge button and split buHon. The com- 
mand buHiOTm In tiie second row are: directory button, 
phone button, ksh bu%>n, X button, and cut— paste 
button. In this user interface, a command button {or a 
window) is selected by posiSoning the cursor on the 
button (or the wrindow) and pressing the left most 
mouse taitton. The uss of the command buttons to 
construct a confisiienee ccmfigurafian is now des- 
cribed. 

To set up a conference, a conferee fiist creates 
a room by sheeting the room button. A room w^th only 
the or|9inatt)9 conferee icon in the room wiH appear. 
Each room has a room vrindow and a room identifier 
window (whitdi is on the top of !}» room window). 
Esch room bas a unique room IdenBfier shown in the 
tasm identifia' window. When the directory button is 
sdected, Ul will display a directory which contains 
1^ ioons (RG. 18) representing all the people that 
can bd reachal firom this woilcstaUon. To make a call, 
ttie originafing conferee puts other conferees into the 
room bf M selecting conferees and then selecting 
the Rxxn window, the Ul wi initiate a call to the 
remote conferees by open^g a multimedia virtual cir- 
cuit connection with conferee addresses as par- 
am^srs. If tfieconneoGon Is e^Ubhed successfully, 
the oi1glna6r^ Ui wBi add the ranote ccmferee icons 
into flie room. Othenrise, the room wll only have tiie 
or^inatlng conferee k»n. if a «dl Ms, the orfginaSng 
conferee can try again by using the same procedure. 
If a call succeeds, the remote site workstations will 
have a conference room which is the same as the con- 
ference room at the originating site. A conference 
room is said to be initially established when a call con- 
nection is esteblished. The first face icon in ttie 
esteUished room is the originator and the nsmaining 
IcorB show the otiter parttes that are also in fiia con- 
ference. FIG. 17 ^ttcms an e^bRshed ro<Mn with 
ttiree pmSe& and FIG. 18 shows a directory. An 
emmvsd mm wfflt no awHiealtona bas only one 
«qignainng:^iani!i^ in fiie eonr»ofon. Uiuses this 
radlii^ cosine! to convnuriicate ses^km lays' mes- 
SEtg^ tor 8iis room. 

After the call has been esteWshed, applications 
can then be added into the room. Unlike conference 
members, applications can be added or deleted 
dynamically. M applicafion is added to a room by first 
sdeciing the application conunand button in the irsain 
Ui menu, and then selecting the room. When an appli- 
c£^n B added to (deleted from) a roorn, a channel is 
acUed to (deleted from) tiie &Mna connectton. By 
conven^n, the first applicaSon added to a confer- 
ence room tea phone. Confierees cat use voice com- 
munication for negotiaUng and for coordinaflon the 
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Other applications to be added to the oonfetence 
room. A phone icon will appear in the roran vrfien a 
phone Is added to a mm The phone is Initiafly 
ontncd(. It goes o^otik vrtieit the phone icon In the 
conference room Is seiet^ An aceessoHitrol menu 
wWi phoneopfions is dfspl^ed, alkwAjg conjereesto 
opiate thi^ phones in different modes. 

Owly one phone can be added to a room, itovt- 
ever, many data applications can be added to aroom. 
There are *wo major classes of data applications that 
can be used in the present embodiment: traditional 
oharacter-tesed applications and graphi&*ased X 
appiicatois. These applicaltons are ^«*^|y Mitten 
for a single user. For adding traditional diarader-ha- 
sed applications, conferees s^ot the ksh button first 
and ftenmeix>n«Br8nce room wfndow.Akshk»n«SII 
appear to m mam aaid a icsh appOcafion window 
which fe created the ksh sqjpllcafion process wHi 
also appear on the display. Traditional character-ba- 
sed application can ttien be invoked through ksh 
application window. To link the icon to the application 
winiow, the icon has a unique name assigned by Ul 
which will also be the tifle of the application window 
and which will appear in the title bar. 

For X applications, a directory menu is provWed 
when the X buttwi is selected. Conferees sdect an 
applicaiibn ton the mMiu sand select tte room to 
create the applicatton in that fodm. Simlar to ksh 
apfSlcaSons, an icon and an appOcaiton window will 
appear when an XajvUcatkm fe added to a room. 

The cut-paste bu^ is used to add a cut-paste 
appliosSfon to a room. The cut-paste program acts like 
a chalkboard which allow conferee to cut images from 
Other windows in the display into the cut-paste appfi- 
catton vnndow. It also allow conferees to erase (cut- 
out) Images fron the cut-paste window. FIG. 19 
illusfrates a dfefrfay for a ctmference room having a 
phone, a ksh applic^n, atxi an X application (ez 
editoi). 

Forapptfeations invoked fiontihe ksh button and 
from the X button, a single copy of the pro-am ims 
a the station where flie applfcaton is invoked. Apoint- 
to-mu!tipoint channel witti upstream capability is 
needed for these applfeatfens. For cut-paste appli- 
cations, each station mns its own copy of the prog- 
ram. A muHipoint-to-multipoint channel is needed for 
ttiis implementation. 

Any application can be deleted fincm a conference 
room by selecting the tnash button and then selecHng 
the applteation icon in the room. The application teon 
and the applicalton window Will disappear when an 
application is trashed. The channel assodated with 
that apfl&a^Sm also be deleted. The trash button 
csai dso be u»d to teraiinate a conference room by 
selecting the room identifier wndow. When a room is 
trashed all applications are dieted first, then the vir- 
tual circuit connertfon Is temtinated. The quit button 
is used to e»t ttie iser intaface and temninate all 



ongoing OHiferences. 

In HKJst conjHfflice ^uatfens, when an ^pli- 
(afion is ^ared. all conferees should have the same 
right to recewe outputs from the applteation and to 
5 input commands to the application. In some situa- 
fioTB. the Input or the output of an application may be 
restricted due to purity, application featores or 
im{rfementea>n reqi*ements. There are many sitoa- 
tions that access contrei wfll be usefal. For example, 
10 one may share some fwivate date writh a subset of 
conferees during a period of ane. Another axampte te 
if one is p^'c^^'ng in two catfrnnees, hefehe may 
aiterraflivdyifetenandtalkaionecQrtfererBeandlis- 
t^ on aRomerctrnfereneeu The control of a eo^e 
IS iransmiffingto<*reoewngfifomanappIkatoni^ 
led access contitd. The capaMi^ for a conferee to 
access a shared applkaflon is called the conferee's 
access capability. An access contrd polkgf dwoibes 
how to assign access capabilities and howto chsmge 
20 access capabilities. 

There can be many policies for access control. In 
the present embodbnent, the transport layer software 
can be requested Ijy the software above to discard 
incontfng padtaetefrom a parfkailar conferees a par- 
25 tlcuiarch8nnel.ThismedianismisusedtoImp!ement 
access control. The transport layer is flexible to allow 
(rther access control policies. 

The access capability basically has four levels: 
input and output, eu^utpnly, input only and no to. For 
so tha phone applteation, these four levels translate to 
hear and iait. hear cwiiy. talk only (can't hear) and 
neiBiw hear nor talk. We define a strict order on Mie 
degree of control on these four levels: input and out- 
put has flie highest order and no to has flie iowe^ 
» order. Our access control policy is as foltows. When 
an appiicatkm is added to a conference room, each 
confiBfee te ghren a in»al access capabiiily and a ceil- 
ing access capai^^ based on tiie type of tiie apfiV 
cafion. F»a phone application, ttre initial capability is 
40 neioforeach conferee (ecpjivalenttoonhooiOandtiie 
ceiling capability is input and output For ksh and cut- 
paste applications, each conferee has input and out- 
put initial capability and ceiling capability. For X 
applications, the controller has mput and output initial 
43 and ceiling capabBities. All others have output onty ini- 
tial and cefling capabfl^. The capability levels 
implemented for each applioattons are dBfaentfrom 
apfdicaflon to appltoatfen. Phone has all four lev^s. 
Ksh and cut-paste has three levels: input and output, 
so output ottfy and no to. X applications only have two 
lev^ffi input and output and no io. 

Only the rantroiler can change anottier con- 
feree's cefling capability. When the controller moves 
a conferee's cuirent capabHity, tiie new level 
K becomes the ceHing capability of that conferee. 

A conferee can change his/her own cuntent 
capabilltytoalowerorahighercapabilitylevd.Acon- 
feree can move to a h^w level as long as «iat level 
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does not exceed hfe/har own ceaing capabiHy. When 
a phone application added to a itxmw ft is iniUany 
onhook (no to). Each conferee needs to diange the 
capabOity to input and ou^ in order to have voice 
conference. 

To change the capabilily, a conferee firrt select 
8ie application icon in the conference loom. An 
access control wndow will appear. The access con- 
trol window shows all the conferee icons and al! poss- 
ible access capability levels are shown on the right 
side of the conferee icon. The current access capabi- 
lity level {not the ceiling capabilily) is highlighted. FIG. 
20 and FIG. 21 show the access control windows of 
phone and teh respecQvdy. By selecSng the access 
capabDitylevd imMed in the access contid WKidow, 
a conferee can diange the eunsnt access capabaitir. 
The penrdsston to dian^ cs^bOiQes is always 
chedced by the Ul according to the pdii^ mentioned 
above. If the change is not pennitted, the cun-ent 
capabiity will not be changed. Conferees can alw^ 
select any application icon to review the ca^iliHes 
of thatapplication. For the phone applleafion. Urn cur- 
rent capability isalsof^ect^lfithephoriaiooiilhthe 
conference room. 

The iiBOord button pfovldea kA tsno conference 
recording, multinnedia document tevieti and anno- 
tatiim. When the record button is selected, a plsy-re- 
eonl menu window vM be aisfisfei (RG. 2?}. TTie 
play^BCOrd menu window has five opfions: play, 
record review, anot, and To record a confeFence, 
it is assumed that die conference room has a phone 
application and a ksh applicatton. When a conferee 
selects the record opfion, a query window will appear 
to input the file name to be recorded to and the ksh 
application to be recorded from. To start the recording 
process, the conferee needs to give the file path name 
(or use the default file name) and seleds fiie ksh 
applicaticK) icon ftom a conferenpe room. The voice 
packets ftom the phone and the data packets finom flie 
ksh application are mult'tdfficed to£jetti«r and stored 
Into the given file. The temporal relationship is main- 
tained when this multimedia file is played bade 

The stop button is used to stop a conference 
recording. When stop is selected, fite i^aynnecrad 
menu window wM disappear. To play badca teccmfed 
file, the T&xxd button is used to di^lay a pl^HreconJ 
window and then the play option is sheeted Similar 
to the recording, a query window b popped up to input 
the file name and the ksh to (day the multim^ia file. 
When playing a file, text dsSa wBi apftess on the ksh 
appjicafion window and vc^ pado^ wffl be sent to 
the voice haritteet The pl^ ofiSan is used to play a 
recorded fie into a confateno! room, so R assumes 
that the Kxnn has a voice application and a ksh appli- 
caSon. A review opfion is provided to let a conferee 
review a document locally. When review is sheeted, 
a quay vnndow will be dtsfdayed for a confeiee to 
input the file name and a ksh window wfll be created 



to review the given fBe. The ksh application does not 
belong to airy conference rootn. Dudng the ttpA&n 
process, voice annotatton can be iriv<^ by selecting 
tiieanotoi^on. SeiecSt^ the anot button wll«dart the 

s annotetion. Voice padcets will be inserted tato flie 
multimedia file. Selecting the anot again w9l stqp file 
annotation. Voice annotation oan ateo be m^e while 
playing a recorded file. 

One major design consideration of the user inter- 

10 face concerns perfbfmanoe of real &ne conference 
operations, in addition to adding/ddeting applications 
to/fifom a conference, fhs conference opcHfations pro- 
vided arm merging two confiaenoes into one confer- 
ence, and spl^ one confsience into \m 

IS conferenoea. The noUont^aeonilHence room Iteusai 
to represent a coidi^rehce. Each conferee and each 
applicatibn frivoived in a oottference are represented 
in the coiifsrence room by a Icon. Fordesktop confer- 
ence, the conferen<» itxim rsfvaseniaiion ^ a con- 

20 venlent way to peifHm ieai time cor^nce 
operatkms. 

When a conferee want to split a conference, 
he/she fg^ selects the split button and then selects 
the conference roan to be split fay selecting the room 

25 ]dentMervrindow.Ul«dll display a shifting menu win- 
dow and a new cwilierence room. HQ. 23a illustrates 
a si^ttfing nnenu, FIG. 23b a room whtoh is being split, 
and RG. 23c a new conference room. The new con- 
ference room have a new klenffflar and the origi- 

30 naBt^confereeiconiniLAspliningn^nuwindowhas 
fourselsdtons: move, copy, abort, and done. 

An application or a conferee can t>e copied or 
moved into the new conference room. When a con- 
feree is copied, it means the conferee will participate 

35 in boSi the original conference and the newly created 
conference. When an application is copied, the origi- 
nal applteation pr»:ess will be kept for the original 
room and a new appOcs^n ir»tance wffl be created 
for the new omferemce room. The contents of the 

40 origir^^i^icaGonMi^ndowwItiiotbeccqiaedintothe 
new applfcatton virindow. When a conferee is moved 
to the new room, he/she will no longer remain in the 
original conference. When an applicafion is moved 
into the new room, the original application may be 

45 deleted firpm a craiferee's worlstation tf the conferee 
is not Bi the new room. The originating conferee uses 
move and copy selections repeatedly to construct the 
new configura&Hi of the wiginal conference room and 
the new conference room. The abort menu aborts the 

50 process. Tf» dtme menu 'mkmts Ul to start the 
spliffiiKl i»ocess. The Ul vnl not the netw(8k to 
split the virtusd ctoiit connei^n ui^ess the done 
memi is selected. Tlie c^inafing Ui needs to infbmi 
each remote Ul how tie conference room vM be spBt 

55 b^bre or after splitting the virtual drcuit. Voice com- 
muntea&in is assumed to be important for conferees 
to coordinate bofft file split and the mage operations, 
if file n^wotk s|^tt opers^n is sucoessfel, the 
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original connecSpn will be sfrfit into too connections. 
In the connedfen for the w^inal mom, ttie channels 
used by the appiicsGons wh*uh have been fnoved are 
closed. In tte connection for 0ie new mm, new dian- 
nds are eroded if new appllcafion iistances aie 
created, FIGS. 24 AND FIG. 24b showfte roan can- 
figwafidns aOar the phone Is copied, and Oie Ic^ 
atH^ication and a conferee are moved from file ia^ 
nsdioom. 

Merging is an inverse process of splitting. To 
m^ge two conferences, the originafing conferee first 
selects the merge button and then selects flie tawo 
rooms to be merged in order fite merge-lroin room 
and the merge-to room. When two conference rooms 
are merged, all congees k these two looms wit be 
merged into the meige-to torn. Exceptfnrthe phone, 
all ^^icafions firom the meig&«c(n room wOl be 
added to the tn^e^o rodm. If bc^ rooms have 
phones, then only the phone hi tiie nwrge-to room is 
kept If a station only has the me^e-from room, the 
merge-Spoti ipam will be modified into the merge-to 
room. This means that api^ica&ms ^ready running 
wOi be kept (except possSUy phoiw applicafion} and 
applicafions firan the merge-to room wll be added. If 
a siBilon only hasa metge-to room, the Ul will perfbrm 
a s&anilarlask. if a siaSon has two rooms, all the appli- 
cations wiB be kept (except only one phone diannel 
is kept). 

Merge and Split Protocol 

In one aitemartive implementafion of a merge and 
split protocol, a merge or sfrflt request is transmitted 
into the network, and the request is propagated 
through the network nodes, finally delivetteg the 
request at all involved workstations. However, the 
merge and split operattons cause alterations in the 
connectivi^ cS the original MI^C(s) and the data 
structures associated With ihe MMVC(s). If a 
merge/spK opaation is coimnitted to using a single 
phase pft^ocd, as described abovt^ then it is imposs- 
ible to ensure that failure of the operaBon mM not dis- 
rupt the original MMVC. For example, enwsion a 
merge request sent Into the networic. One node in the 
networics accepts the request, updates it data struc- 
tures and forwards the request on to the next node. 
Unfortunately, the second node does not have fte 
resources to complete &ie merge and thus denies the 
request, in Ms case the o^inal UmCs can not be 
recovered, since the first node has already committed 
to the operation; fliere Is rKJ altemafive butto dearthe 
laMVC. This fs <nsasiitais fwrthe user, not only is his 
request dwiled but his prevtoiisly stable connection is 
destroyed. 

For this reason, the preferred embodiment is a 
two phase protocol. The protocol minimizes the effect 
of a failed operation on the user. The first phase of the 
protocol used to detennine S components, that 



is work-stations and network nodes, agree to com- 
plete the merge or sjrfit operatbn. When the works- 
tatton originating the operation detennines that all 
(x»np<Hients have agreed to fiie operation, it initiates 

s the second phase of the protocol by issuing an accept 
m^sse. The accept message indicates that all com- 
. ponents should complete the merge orspiitoperation. 
If any component denies the requested operation dur- 
ing ttie initia! phase, then fte original MMVC{s) are 

10 unaffected. 

The preferred protocol is shown in FIG. 25. The 
"mig/splt— inquiry" is a sessfon layer to session layer 
conmunkation. The loctl (nvg^llQ', ref^ents an 
k>eV calt made by file sesston l£^r requesting a 

IS merge or sfdit be Initiated by fiie transportlayer. 

Once the transport layer receives a merge or split 
command via an iocti call, it sends a merge or split 
request (denoted wnMrg/wnSpIt in FiG. 25) into the 
network; the latter acknowledges the receipt of the 

20 packet When a wnMrg or WnSplit packet is received 
at an endstatfon, it is immediately acknowledged by 
ttietransportlayervwth a wnAckpacket Thisonly indi- 
cates that the pactet was leceh^ed at the endstation. 
The recepof a wnMig orwnSplitalso causes a ses- 

25 ston layer listen process to be given a merge or split 
r^uest message/The listen process in turn issues a 
mageorspiaiooa c^ on thefarend woriffltation. The 
transport layer of eaejt farend worfcstation ttien sends 
and end-to-end admowledgement to the originating 

30 workstaSon, Indteafing that fitey agree to the 
merge/split request 

Once the oi^inafing woriratation has received an 
end to end acknowledgement firom all participating 
workstations, a vmMaccept or wnSaccept packet is 

35 issued. The accept padcet Indicates that all ends- 
tatkms lave acknowledged rec^pt file merge or 
split request and each station agreed to the merge or 
split command. This pactet as^ as a commit; after 
be^ sent the merge or split command can not be 

40 aborted. Upon receiving this packet the far end woric- 
siafions send an end-to-end adtnowledgement and 
flien return from the loctl caO. The s«x»nd set of end- 
to-end acknowledgements are u»d to Indicate when 
the originating woricstafion can tebim from the kxjil 

45 call. Once these acaoKivKledgaments are teoeWed all 
oonnecSons aie estatdtehed and packet transfer can 
begin nrBnedlately. 

It '6 to be understood th££ the above-described 
embodiments are merdy llustrative of the principles 

50 of the Invention and ttiat many variations may be dev- 
ised by ttose skffled in the art without departing from 
ttie s|ririt and scope of ttie invention. It is therefore 
Intended tt«t such variations be iiduded vifithin the 
scope of the daims. 
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Claims 

1. A method/for use in an airangament comprising 
a communlcafion netwpifc ii^ieteonnec&ng a 
plural!^ of us«»rstaQons. said method comprising 

pravkiing a first csdl among a first set of 
said user stations, 

proinding a second among a second 
set of said user stations and 

merging said first and second calls into a 
single call, comprising a plurality of channels, 
among at least three user stetions from said first 
and second sets, saW pluraiay of channels cme- 
sponding to a combinafion (^(diannels of said first 
and second calls. 

2. AmethodinaceordancewiSidalmlwheeinsaid 
mergir© comprises 

merging said Urst and second calls into a 
stngtecail connection, coRprtsing said plurality of 
channels, among the wion of said first and sec- 
ond sets of user stations. 

3. A method in accordance with daim 1 wherein said 
first call comprises a signaling channel, said sec- 
ond call comprises a signaling channel, at least 
one of said first and second calls further com- 
prises at least one non^ignanng channel, and 
^id pluiality of chann^ comprises a ^naiing 
channel and at least one non-etgnalbtg channel. 

4. A mefliod in accordance witii daim 1 wherein said 
finst call wmprisesatieast one data chani^, said 
second call comprises at least one data diannel, 
and said pluralRy of channel Inchides a data 
channel for eadh data channel of said first and 
second calls. 

5. A method in accordance with clatti 4 wherein at 
least one of said first and second calls further 
comprises a voice channel, teind said iHurfdHy of 
channels 1urth«- indudes a voice channel 

& AmethodinaccordamsuMidaHnSw^ereinsaid 
f&st caH furftar comprises a signaling channel, 
said second cadi fiMhar ccnnprises a signaling 
channel, and said {Huraliiy of ctemndb furiher 
indudes a signaDng cihannd. 

7. A method in accordance cliaim 4 wherein at 
least one said fii^ and second calls further 
comprtees an annage channel, and said plunalify of 
diannels lurtiier Indudes an im^e chant^L 

8. A n^od in accordance with da'nt 4 wherein at 
least one of ssai first and second calls liiriher 
conqirises a video ctannei, ami said pluralify of 
channels further indudes a video chsainel. 



9. Amethod in accardancevwthclaBTil wherein said 
plural!^ of chspm^s conprise virtual channds Of 
a mdtk»st connect. 

s la. AmeBiod in accordance with daim 1 fijrthercom- 
prisit^ in response to user input, selectively pro- 
viding said at least three user stations with 
access to transmit Inforaration to and receive 
information from said plurality of channels. 

10 

11. A mettiod in accordance with daim 1 wherein at 
least one of said first set of user stafiens and at 
least one of said second set of uiser j^ons 
indude display means, said method further «»n- 

is prising 

In nesponse to user infwt at said one of 
sakt fksf ^tstatlons, boKi establfehing said first 
call in said networic and dfeplaying repr^en- 
tafions corresponding to said first set Cff user sta- 
20 tlons h a window on said display meaiis of said 
one of said first set stations, and 

in response to user input at said one of 
said second set stations, both establishing said 
second call in add networit and disple^ng repre- 
ss sentations ticwesponding to sdd second set of 
user stations in a window on said display means 
of said one of «aJd second set stafions. 

12. Amefhod in accordance wifhdaiml wherein one 
30 of said pluralily of user staSons is a member of 

both of said first and second sets, said one user 
station comprises display means, said merging is 
in response to user input at said one user stetton, 
said method further comprising 
35 further in response to said user input at 

said one user station, displaying representaflons 
corresponding to user stations of said first and 
second sets In a wlrMiow on sa^ display means. 

40 13. A tn^mii in accoidaree With daim 12 Holher 
cGDiprisIng 

ftirSter In response to said user Input at 
saM one usierstefion, disj^aying, in saidviilndow, 
representzfflons eadj corresponding to one of 

45 said plurality of channels. 

14. A method in accordance with daim 12 wherein 
said plurality of channels indudes at least one 
data channel, said method further comprising 
so d'si^ayiag, in a second window of said dis- 

ptety mean^ a data oommui^sailon appOcafitm 
shared artwng useratatlions of saW first and sec- 
ond sets i4a said one data dtannei. 

85 15. A method in accordance witti daim 1 wherein one 
of said plurality of user stations is a rnember of 
of said fir^ and second sets, said method 
furtho-oompri^ 
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